Belief Propagation by Message Passing in Junction Trees: Computing Each Message Faster Using GPU Parallelization
نویسندگان
چکیده
Compiling Bayesian networks (BNs) to junction trees and performing belief propagation over them is among the most prominent approaches to computing posteriors in BNs. However, belief propagation over junction tree is known to be computationally intensive in the general case. Its complexity may increase dramatically with the connectivity and state space cardinality of Bayesian network nodes. In this paper, we address this computational challenge using GPU parallelization. We develop data structures and algorithms that extend existing junction tree techniques, and specifically develop a novel approach to computing each belief propagation message in parallel. We implement our approach on an NVIDIA GPU and test it using BNs from several applications. Experimentally, we study how junction tree parameters affect parallelization opportunities and hence the performance of our algorithm. We achieve speedups ranging from 0.68 to 9.18 for the BNs studied.
منابع مشابه
Hardware - Efficient Belief Propagation
—Loopy belief propagation (BP) is an effective solution for assigning labels to the nodes of a graphical model such as the Markov random field (MRF), but it requires high memory, bandwidth, and computational costs. Furthermore, the iterative, pixel-wise, and sequential operations of BP make it difficult to parallelize the computation. In this paper, we propose two techniques to address these is...
متن کاملExploring Multiple Dimensions of Parallelism in Junction Tree Message Passing
Belief propagation over junction trees is known to be computationally challenging in the general case. One way of addressing this computational challenge is to use node-level parallel computing, and parallelize the computation associated with each separator potential table cell. However, this approach is not efficient for junction trees that mainly contain small separators. In this paper, we an...
متن کاملMPI- and CUDA- implementations of modal finite difference method for P-SV wave propagation modeling
Among different discretization approaches, Finite Difference Method (FDM) is widely used for acoustic and elastic full-wave form modeling. An inevitable deficit of the technique, however, is its sever requirement to computational resources. A promising solution is parallelization, where the problem is broken into several segments, and the calculations are distributed over different processors. ...
متن کاملFaster Algorithms for Max-Product Message-Passing
Maximum A Posteriori inference in graphical models is often solved via message-passing algorithms, such as the junction-tree algorithm, or loopy belief-propagation. The exact solution to this problem is well known to be exponential in the size of the model’s maximal cliques after it is triangulated, while approximate inference is typically exponential in the size of the model’s factors. In this...
متن کاملMulti-GPU simulations of Vlasov's equation using Vlasiator
We present a numerical method, based on a three-dimensional finite volume wave-propagation algorithm, for solving the Vlasov equation in a full six-dimensional (three spatial coordinates, three velocity coordinates) case in length scales comparable to the size of the Earth’s magnetosphere. The method uses Strang splitting to separate propagation in spatial and velocity coordinates, and is secon...
متن کامل